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- The MAILING DA TE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS. 

WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent tenm adjustment. See 37 CFR 1.704(b). 

Status 

1)S Responsive to communication(s) filed on 02 August 2007 . 
2a)^ This action is FINAL. 2b)D This action is non-final. 

3) 0 Since this application is in conidition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) [3 Claim(s) 1-6.8-1 6 and 19-57 is/are pending in the application. 

4a) Of the above clalm(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) n Claim(s) 1-3.5.6.8-16, 19-27 and 29-57 is/are rejected. 

7) ^ Claim(s) 4.28 and 31 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)\Z] accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .d5(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (0- 
a)n All b)n Some * 0)0 None of: 

1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3,n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Response to Amendment 

1 . The amendment filed 8/2/2007 lias been entered. Clainps 1 ,2,21 ,22,26, and 29 
have been amended. Accordingly, claims 1-6,8-16 and 19-57 are pending in this office 
action. 

Allowable Subject Matter 

Claims 4,28,31 are objected to as being dependent upon a rejected base claim, 
but would be allowable If rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth In section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 

USPQ 459 (1966), that are applied for establishing a background for determining 

obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 



Application/Control Number: 10/678,606 Page 3 

Art Unit: 2166 

4. Considering objective evidence present in tlie application indicating 
obviousness or nonobviousness. 

Claims 1-3, 5-6, 8-16. 21-22, 25-55 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over US 20020140820 (hereinafter Bord) in view of US 20050050043 

(hereinafter Py). 

As for claim 1 Bord discloses: receiving user input defining a plurality of calendar 
entries each calendar entry in the plurality of calendar entries comprising a respective 
topic and a respective time interval, Wherein a rule specifies the respective topic for at 
least one calendar entry identifying a digital image, the digital image being associated 
with a time stamp (See paragraph 0017 and paragraph 0020); 

displaying a presentation of the time interval and the digital image 
While Bord does not differ substantially from the claimed invention Bord lacks an 
explicit disclosure of automatically selecting a calendar entry in the plurality of calendar 
entries, the selected calendar entry having a time interval that includes the time stamp 
of the image; and automatically associating the selected calendar entry with the digital 
image. Py however, does explicitly disclose automatically selecting a calendar entry in 
the plurality of calendar entries (See paragraph 0038), the selected calendar entry 
having a time interval that includes the time stamp of the image; and automatically 
associating the selected calendar entry with the digital image (See paragraph 0038). It 
would have been obvious to an artisan of ordinary skill in the pertinent at the time the 
invention was made to have incorporated the teaching of Py into the system of 
Bord.The modification would have been obvious because the two references are 
concerned with the solution to problem Time based image management, therefore there 
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is an implicit motivation to combine these references. In other words, the ordinary skilled 
artisan, during his/her quest for a solution to the cited problem, would look to the cited 
references at the time the invention was made. Consequently, the ordinary skilled 
artisan, would have been motivated to combine the cited references since Py's teaching 
would enable users of the Bord system to add metadata maintenance to their 
organizational abilities 



As for claim 2 Bord discloses: receiving a digital image, the digital image 
associated with a time stamp (See paragraph 0017); receiving user input defining a 
calendar entry comprising a first topic and a first time interval Wherein a rule specifies 
the first topic for the first calendar entry identifying a digital image (See paragraph 
0017), comparing the first topic with the second topic or the first time interval with the 
second time interval (See paragraph 0018 note: user selects date range all events or 
topics are show in that range), the comparison based on configurable rules; based upon 
the comparison, automatically selecting one the calendar entries to associate with the 
digital image (See paragraph 0017); and storing an association between the selected 
calendar entry and the digital image on a computer-readable medium (See paragraph 
0017). While Bord does not differ substantially from the claimed invention the 
disclosure of the first time interval including the time stamp; receiving user input defining 
a second calendar entry comprising a second topic and a second time interval; the 
second time interval overlapping with the first time interval and including the timestamp 
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is not necessarily explicit. Py however does disclose the first time interval including the 
time stamp (See paragraph 0037); receiving user input defining a second calendar entry 
comprising a second topic and a second time interval; the second time interval 
overlapping with the first time interval and including the timestamp (See paragraph 0037 
note folders can have overlapping times with the same events in the subfolders). It 
would have been obvious to an artisan of ordinary skill in the pertinent at the time the 
invention was made to have incorporated the teaching of Py into the system of 
Bord.The modification would have been obvious because the two references are 
concerned with the solution to problem Time based image management, therefore there 
is an implicit motivation to combine these references. In other words, the ordinary skilled 
artisan, during his/her quest for a solution to the cited problem, would look to the cited 
references at the time the invention was made. Consequently, the ordinary skilled 
artisan, would have been motivated to combine the cited references since Py's teaching 
would enable users of the Bord system to add metadata maintenance to their 
organizational abilities 

As for claim 3, the rejection of claim 2 is incorporated, and further Bord discloses: 
wherein each calendar entry further includes a note, the note including a classification 
for the topic represented by the calendar entry and the selecting is based on 
classification of the topics represented by the calendar entries (See paragraph 0008). 
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As for claim 5, the rejection of claim 1 is incorporated, and further Bord discloses: 
wherein the storing of the association includes tagging the digital image with an 
identifier of the calendar entry (See paragraph 0018). 

As for claim 6, the rejection of claim 5 is incorporated, and further Py discloses 
wherein the digital image is stored in a file that includes a metadata field(See paragraph 
0034); the calendar entry includes a label(See paragraph 0035 note: the subject of the 
image is a label); and the tagging includes storing the label in the metadata field (See 
paragraph 0035). 

As for claim 8, the rejection of claim 5 is incorporated, and further Py discloses 
wherein rules specify the topic of the calendar entry represents one of a person, a 
geographic location, confirmation is to be requested before associating the digital image 
with the identifier (See paragraph 0055).. 

As for claim 9, the rejection of claim 1 is incorporated, and further Py discloses 
receiving an image grade definable by user input, the image grade specifying a level of 
interest for the digital image; and storing an association between the image grade and 
the digital image on the computer-readable medium (See paragraph 0041). 

As for claim 10, the rejection of claim 9 is incorporated, and further Py discloses: 
receiving search criteria specifying a threshold grade; and searching the computer- 
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readable medium for digital images that have grades exceeding the threshold grade 
(See paragraph 0041). 

As for claim 11 , the rejection of claim 1 is incorporated, and further Py discloses: 
receiving an image grade definable by user input, the image grade specifying a level of 
quality for the digital image; associating the image grade with the digital image; and 
storing an association between the image grade and the digital image on the computer 
-readable medium (See paragraph 0041).. 

As for claim 12, the rejection of claim 1 1 is incorporated, and further Bord 
disclosese receiving search criteria specifying a threshold grade and searching the 
computer- readable medium for digital images that have grades exceeding the threshold 
grade (See paragraph 0035). 

As for claim 13, the rejection of claim 1 is incorporated, and further Bord 
discloses: receiving one of a text file, audio file or video file and associating the text file, 
audio file or video file with the digital image (See paragraph 0027). 

As for claim 14, the rejection of claim 1 is incorporated and further Py discloses: 
receiving search criteria specifying a particular calendar entry in the plurality of calendar 
entries and searching for digital images associated with the particular calendar entry 
(See paragraph 0035). 
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As for claim 15, the rejection of claim 1 is incorporated, and further Bord 
discloses: presenting a link with the selected calendar entry, the link being configured to 
return any digital images associated with the selected calendar entry (See paragraph 
0018). 

As for claim 16, the rejection of claim 1 is incorporated, and further PY discloses: 
receiving user input specifying a topic; and storing the user input into the note field (See 
paragraph 0041). 

Claims 21 and 22 are computer program product and system claims 
corresponding to the method of claim 1 and are thus rejected for the same reasons as 
set forth in the rejection of claim 1 . 

As for claim 25, the rejection of claim 1 is incorporated and further Bord 
discloses: presenting the selected calendar entry on a display device (See paragraph 
0016), the calendar entry being presented in a calendar-centric representation including 
a presentation of: the time interval and the digital image (See paragraph 0023) 

Claims 26-28 are program product claims corresponding to the method of claims 
2-4 respectively and are thus rejected for the same reasons as set forth in the rejection 
of claims 2-4. 
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Claims 29-32 are system claims corresponding to the method of claims 2-4 
respectively and are thus rejected for the same reasons as set forth in the rejection of 
claims 2-4. 

Claims 32-43 are program product claims corresponding to the method of claims 
5-6.8-16 and 25 respectively and are thus rejected for the same reasons as set forth in 
the rejection of claims 5-6,8-16 and 25. 

Claims 44-55 are system claims corresponding to the method of claims 5-6,8-16 
and 25 respectively and are thus rejected for the same reasons as set forth in the 
rejection of claims 5-6,8-16 and 25. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the Invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

Claims 19,20,23 and 24 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Bord. 
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As for claim 19 Bord discloses: clustering images in an image library into groups, 
each image including a time stamp that indicates when the image was captured (See 
paragraph 0020), for each group, determining the number of images in the group and a 
time interval delimited by an earliest time stamp and a latest time stamp of images in 
the group; for each group (See paragraph 0021), determining a time scale for displaying 
the group, the determining being based on the number of images in the group and the 
time interval delimited by an earliest time stamp and a latest time stamp of images of 
the group; and when an image of a group is selected (See paragraph 0023), displaying 
other images of the group over a timeline having the time scale determined for 
displaying the group (See paragraph 0023). 

As for claim 20, the rejection of claim 19 is incorporated, and further Bord 
discloses: wherein the timeline is a calendar (See paragraph 0023) 

Claims 23 and 24 are computer program product and system claims 
corresponding to the method of claim 19 and are thus rejected for the same reasons as 
set forth in the rejection of claim 19, 

Claims 56 and 57 are computer program product and system claims corresponding to 
the method of claim 20 and are thus rejected for the same reasons as set forth in the 
rejection of claim 20. 
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Response to Arguments 

Applicant's arguments filed 8/2/2007 have been fully considered but they are not 
persuasive. 

Applicant argues: 

Borden appears to be silent is regards to a topic of a calendar entry being 
specified by a rule, as required by amended independent claim 1. Rather, Borden 
appears to describe associating digital image files with calendar dates 

Examiner responds: 

Examiner is not persuaded. Examiner is entitled to give claim limitations their 
broadest reasonable interpretation in light of the specification. Interpretation of Claims- 
Broadest Reasonable Interpretation: During patent examination, the pending claims 
must be 'given the broadest reasonable interpretation consistent with the specification.' 
Applicant always has the opportunity to amend the claims during prosecution and broad 
interpretation by the examiner reduces the possibility that the claim, once issued, will be 
interpreted more broadly than is justified. In re Prater, 162 USPQ 541,550-51 (CCPA 
1969). 

Applicant argues: 

Neither Bord nor Py disclose or suggest that when an image in a group of images 
is selected other images from the group are displayed over a timeline having a time 
determined for displaying the group as recited in claim 19. 
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Examiner responds: 

Examiner is not persuaded. Examiner has cited paragraph 0023 of Bord for 
disclosing the limitation when an image in a group of images is selected other images 
from the group are displayed over a timeline having a time determined for displaying the 
group. Paragraph 0023 states that when dates or any other property is selected thumb 
nail images corresponding the selected date or property are also displayed. 
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Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Leon J. Harper whose telephone number is 571-272- 
0759. The examiner can normally be reached on 7:30AM - 4:00Pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Hosain T. Alam can be reached on 571-272-3978. The fax phone number a 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status infonnation for unpublished applications is available through Private PAIR only. 
For more infonnation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

LJH 

Leon J. Harper "VwA^^^j'V*^ 



October 13, 2007 
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